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The  research  supported  by  (.’rant  A FOSR -82-0033  was  primarily  concerned  with  signal 
detection,  however  some  effort  was  also  directed  toward  t  he  area  of  block  truncation  coding 
for  image  compression.  Results  obtained  pertaining  to  the  latter  will  be  summarized  first. 

Block  truncation  coding  (BTC)  is  a  technique  for  image  compression  which  is  easy 
to  implement  and  often  possesses  good  performance  characteristics,  relative  to  other  ap¬ 
proaches.  even  in  the  presence  of  many  channel  errors.  Furthermore,  the  BTC  algorithm 
doe1-  not  depend  on  knowledge  of  the  specific  underlying  statistical  distributions,  but  rather 
on  sample  moments.  The  basic  BTC  technique  employs  a  two  level  quantizer  whose  output 
levels  are  obtained  by  matching  sample  moments.  The  quantizer's  threshold  is  either  taken 
a  priori  to  equal  the  sample  mean  (ami  thus  the  output  levels  are  chosen  so  that  the  first 
two  sample  moments  are  preserved),  or  the  threshold  is  chosen  so  as  to  preserve  a  third 
sample  moment.  The  latter  approach,  while  somewhat  more  complicated  to  implement, 
often  yields  improved  performance  since  three  moments  are  preserved  instead  of  two. 

The  developers  of  the  technique  presented  formulas  specifying  the  quantizer  thresh¬ 
old  and  output  levels  so  that  the  first  three  sample  moments  were  supposedly  preserved. 
I’nfortunalely,  however,  the  formula  specifying  the  quantizer  threshold  contained  an  er¬ 
ror.  and  one  result  we  therefore  obtained  was  a  correction  of  this  quantity.  Moreover,  the 
developers  of  the  technique  noted  that  rounding  a  certain  quantity  to  an  integer  was  at 
times  necessary  in  practice:  however,  there  existed  ambiguity  in  precisely  at  what  point  in 
tin  algorithm  the  rounding  should  occur.  We  therefore  investigated  the  perturbation  of 
the  relevant  quantity,  and  found  that  it  was  fortunately  preferable  from  the  standpoint  of 
all  three  moments  for  the  rounding  to  lx*  done  consistently  in  one  way.  We  furthermore 
investigated  the  effects  of  rounding  the  quantity  on  the  performance  and  noted  that  for 
very  many  cases  it  should  not  be  serious.  These  results  were  delineated  in  -•••  10  of  the 
publication  list. 

Noting  that  the  BTC  approach  preserves  sample  moments  (two  moments  with  one 
method  and  three  with  the  other),  we  also  investigated  whether  or  not  improved  perfor¬ 
mance  could  be  obtained  by  employing  moments  other  than  the  first  two  or  three.  We 
found  that  the  original  BTC  scheme  could  be  generalized  to  yield  a  family  of  moment 
preserving  quantizers  using  higher  sample  moments.  In  particular,  we  found  closed  form 
expressions  for  the  quantizer  output  levels  which  preserved  the  n-th  and  2n-th  moments 
when  a  threshold  equal  to  the  Ln  norm  of  the  samples  was  employed:  we  also  found  closed 
form  expressions  specifying  the  quantizer  output  levels  and  threshold  which  preserved  the 
n-th.  2n-th.  and  3n-th  moments.  We  then  applied  these  results  to  various  example  images 
and  found  that  improvement  in  performance  was  obtainable  by  the  use  of  higher  moments, 
both  from  t  he  standpoint  of  mean  absolute  and  mean  squared  error.  Finally,  we  noted  lhat 
then'  wa-  a  subclass  of  this  family  of  moment  preserving  quant i/ers  for  which  practical 
difficulties  in  implementation  exist;  we  then  showed  that  frequently  this  subclass  could  be 
avoided  to  still  obtain  good  performance.  These  results  were  delineated  in  ;•  1  and  ■>>  13  of 
t  li<  publicat  ion  ] isl . 

■  > 


Noting  the  general  applicability  of  sample  moments,  we  also  considered  an  alternative 
to  th*‘  HTC  scheme  which  used  sample  moments  as  a  measure  of  the  rapidity  of  image  vari¬ 
ation  over  pixel  blocks.  This  approach  had  as  a  particular  goal  the  high  quality  restoration 
of  those  portions  of  the  image  with  most  rapid  variation  in  gray  level  (such  as  edges).  We 
designed  an  algorithm  which  not  only  was  successful  in  accomplishing  this  goal  but  also 
was  accompanied  by  the  somewhat  surprising  consequence  that  certain  nontrivial  images 
were  restored  with  no  degradation  whatsoever.  The  latter  consequence  was  in  force  when¬ 
ever  the  number  of  edges  present  in  the  image  was  no  larger  than  a  specified  number  which 
depended  on  the  desired  image  compression  ratio.  These  results  were  delineated  in  ^8  of 
t  he  publication  list . 

A  number  of  results  pertaining  to  the  detection  of  signals  in  non-Gaussian  noise  were 
obtained.  For  example,  a  classical  detector  of  time  varying  deterministic  signals  in  depen¬ 
dent  noise  is  the  matched  filter,  which  maximizes  the  output  signal  to  noise  pow'er  ratio; 
it  is  also  Neyman-Pearson  optimal  in  the  particular  case  when  the  noise  is  Gaussian.  In 
many  situations  it  is  reasonable  to  expect  that  the  signal  will  be  known  at  discrete  instants, 
thus  admitting  the  design  of  the  discrete  time  matched  filter.  However,  it  is  often  a  very 
different  matter  to  assume  that  the  signal  will  be  known  exactly  as  a  closed  form  analytical 
expression  over,  for  example,  an  interval  of  time,  which  w'ould  be  necessary  for  the  design 
of  a  matched  filter  in  continuous  time.  While  the  signal  may  thus  be  incompletely  known, 
it  is  reasonable  to  expect  that  in  many  cases  it  could  be  modeled  as  bandlimitcd.  If  we 
furl  hermore  assume  the  signal  is  known  at  a  fixed  number  of  instants,  we  might  hope  that 
a  continuous  time  filter  could  be  designed  which  would  be  insensitive  to  the  remaining 
inexactness  in  our  knowledge  of  the  signal.  Such  a  filter  might  also  have  the  potential 
for  improved  performance  over  the  discrete  time  filter.  Using  a  saddlepoint  criterion,  we 
obtained  a  result  which  specified  the  form  of  such  a  filter.  We  then  showed  the  saddlepoint 
criterion  did  indeed  impart  robustness  into  the  filter;  in  fact,  the  output  signal  to  noise 
power  ratio  was  shown  to  be  invariant  over  all  appropriate  continuous  time  signals  consid¬ 
ered.  Moreover,  we  also  showed  that  the  performance  (as  measured  by  outpul  signal  to 
noise  power  ratio)  of  this  robust  continuous  time  filter  upper  bounded  that  of  the  discrete 
time  filter.  Finally,  we  showed  by  way  of  example  that  strict  improvement  in  performance 
over  the  discrete  time  filter  was  possible.  Employment  of  continuous  time  would  thus  seem 
to  be  useful  even  in  some  cases  which  appear  appropriate  to  discrete  time.  These  results 
were  delineated  in  ft  1 1  of  the  publication  list. 

We  also  investigated  a  situation  w'here  inexact  knowledge  of  the  statistics  of  the  noise 
was  present  for  the  discrete  time  detection  of  time  varying  deterministic  signals  in  i.i.d. 
non-Gaussian  noise.  In  earlier  work  employing  the  canonical  form  of  the  locally  optimal 
detector,  some  other  authors  showed  how  the  design  of  the  asymptotically  robust  detector 
for  the  lluber-Tukey  mixture  class  of  noises  could  be  obtained.  As  might  have  been 
expected,  the  results  led  to  censoring  the  factors  of  the  test  statistic  to  impart  robustness, 
w  Inch  led  to  the  employment  of  a  detector  nonlinearity  which  limited  observations  of  large 
magnitude.  However,  this  work  did  not  take  into  account  the  common  situation  where 
more  is  known  about  a  noise  density  near  the  origin  than  on  the  tails.  In  fact,  the  noise 
often  arises  in  practice  from  the  sum  of  a  number  of  ‘‘nearly”  independent  sources,  and 


thus  frequently  the  noise  density  resembles  the  Gaussian  near  the  origin  but  may  differ 
markedly  on  the  tails.  Such  knowledge  had  the  potential  to  be  exploited  for  improved 
performance,  where  the  robustness  is  imparted  to  account  for  our  lack  of  knowledge  of 
the  tails  of  the  noise  density.  We  investigated  this  situation  and  obtained  results  which 
specified  an  asymptotic  ally  robust  detector  for  the  case  where  the  noise  density  was  known 
on  an  interval  about  the  origin.  We  then  showed  by  way  of  example  that  the  approach 
led  to  improved  performance  over  the  previous  one;  in  fact,  the  improvement  was  quite 
dramatic  in  certain  cases.  These  results  were  delineated  in  jf  2  and  4j  16  of  the  publication 
list . 


In  addition,  we  considered  the  discrete  time  robust  detection  of  a  known  constant 
signal  in  additive  independent  and  identically  distributed  nominally  Laplace  noise.  The 
heavy  tailed  nature  of  the  Laplace  density  function  makes  it  a  popular  model  for  such 
non-C iaussian  noise  as  that  encountered  in  atmospheric  or  undersea  environments.  We 
observed  t fiat  applying  some  existing  results  of  Huber  allowed  deducing  the  form  of  the 
test  statistic  as  a  censored  version  of  the  test  statistic  which  is  Neyman-Pearson  optimal. 
Since  the  performance  of  robust  detectors  is  an  important  subject  which  has  been  largely 
unexplored,  we  pursued  such  an  investigation  with  the  hope  of  exploiting  the  often  tractable 
Laplace  model  for  the  nominal  distribution.  We  were  able  to  obtain  closed  form  solutions 
for  the  distribution  of  the  censored  test  statistic  under  both  hypotheses,  with  the  result 
that  the  performance  could  be  measured  via  receiver  operating  characteristic  cun  os  which 
plotted  detection  probability  versus  false  alarm  rate.  Such  curves  were  then  determined 
for  various  cases  of  interest.  A  comparison  of  these  curves  with  those  for  the  Neyman- 
Pearson  optimal  case  was  then  performed,  thus  showing  the  effect  of  various  degrees  of 
contamination  of  the  nominal  distribution  on  the  performance  of  the  robust  detector  when 
compared  to  the  Neyman-Pearson  optimal  one.  These  results  were  delineated  in  f  4  of  the 
publication  list. 

In  addition  to  the  aforementioned  robustness  applications,  we  also  considered  a  non¬ 
par  ametric  detector,  the  modified  sign  detector,  for  the  discrete  time  detection  of  a  constant 
signal  in  dependent  noise.  Kriiploving  the  very  general  strong  mixing  class  of  dependent 
noises,  we  specified  the  design  of  the  modified  sign  detector  both  under  asymptotic  and 
finite  sample  criteria.  We  found  that  this  design  varied  greatly  from  that  for  a  simpler 
model  of  dependency  which  used  m-dependent  processes.  Our  results  showed  how  the 
detec  tor's  design  depended  on  a  quantitative  measure  of  the  rate  of  “decrease”  in  depen¬ 
dence  between  samples  as  the  samples  were  more  widely  separated  in  time.  An  example 
was  presented  which  illustrated  the  complete  design  of  the  detector  for  the  case  where  the 
dependency  rollofr  was  consistent  with  that  of  an  autoregressive  strong  mixing  process. 
These  results  were  delineated  in  #15  of  the  publication  list. 

The  area  of  memory  less  discrete  time  detection  of  signals  in  cp-mixing  noise  has  been 
studied  by  us  in  the  past  for  both  the  case  when  the  signal  was  constant  and  when  it  was  also 
a  random  process.  The  detector  structure  employed  consisted  of  a  memoryless  nonlinearity 
followed  by  an  accumulator  and  threshold  comparator,  which  was  Neyman-Pearson  optimal 
in  the  independent  noise  case.  Using  the  crite  rion  of  asymptotic  relative  efficiency,  these 


earlier  results  accounted  for  the  dependency  by  specifying  the  detector  nonlinearity  which 
opt  imized  performance.  This  nonlinearity  appeared  as  the  solution  of  an  integral  equation 
\\  hich  unfortunately  involved  second  order  statistics  of  the  random  processes  present.  Since 
such  statistical  knowledge  may  often  be  incomplete,  we  investigated  alternative  approaches 
which  required  less  statistical  knowledge  and  which  were  easy  to  implement. 

For  example,  we  considered  the  detection  of  a  constant  signal  in  weakly  dependent  ©- 
mixing  noise  using  two  approaches.  For  the  first,  the  locally  optimal  detector  was  employed, 
resulting  in  the  need  to  know  only  the  univariate  noise  density.  Since  this  approach  ignores 
the  dependency,  it  is  of  course  important  to  inquire  into  its  performance.  We  therefore 
obtained  a  bound  on  the  degradation  in  performance  which  was  expressed  in  terms  of  the 
o- representation  of  the  noise.  This  bound  showed  quantitatively  how  close  the  performance 
of  the  locally  optimal  detector  was  to  optimal  for  various  ©-representations.  The  second 
approach  considered  a  more  general  form,  consisting  of  the  locally  optimal  nonlinearity  plus 
a  linear  correction  term.  Such  a  structure  has  been  showrn  to  yield  improved  performance 
under  a  moving  average  weak  dependence  model.  We  then  showed  that  in  the  much  more 
general  ©-mixing  case,  such  improved  performance  is  unfortunately  not  possible  uniformly 
over  the  class  of  noise  processes  possessing  a  given  6- representation.  In  fact,  for  any 
appropriate  ©-representation,  we  showed  that  there  must  exist  such  a  process  for  which 
the  locally  optimal  detector  outperforms  the  one  with  the  linear  correction  term.  Because 
of  this  result,  we  might  in  practice  simply  w'ish  to  employ  the  locally  optimal  detector  in 
1  he  absence  of  the  required  statistical  knowledge.  These  results  were  delineated  in  #9  of 
the  publication  list. 

Motivated  by  the  work  immediately  above,  we  then  investigated  the  effect  on  the 
detector's  performance  induced  by  more  general  alterations  of  the  form  of  the  detector 
nonlinearity  from  that  of  the  asymptotically  optimal  nonlinearity.  These  results,  which 
applied  to  the  detection  of  a  constant  signal  in  weakly  dependent  ©-mixing  noise,  showed 
that  the  resultant  degradation  in  performance  can  be  bounded  in  terms  of  the  Ly  distance 
between  the  optimal  nonlinearity  and  the  nonlinearity  of  interest.  As  might  be  expected, 
t  his  bound  also  involved  the  ©-representation  of  the  noise.  In  particular,  our  results  showed 
that  asymptotic  relative  efficiency  can  be  viewed  as  a  mapping  bet  ween  metric  spaces  which 
is  continuous  at  the  point  of  interest.  These  results  were  delineated  in  ^6  and  17  of  the 
publication  list . 

We  also  considered  an  alternative  approach  w'hich  was  applied  to  memoryless  discrete 
time  detection  of  random  signals  in  noise,  where  in  this  case  both  the  signal  and  noise 
wi  re  random  processes  (not  necessarily  independent  of  each  other)  whose  maximal  corre¬ 
lation  coefficient  sequences  were  summable.  Such  processes  are  strong  mixing,  moreover 
this  class  includes  as  a  proper  subset  the  class  of  d>-mixing  processes.  In  some  earlier  work 
we  showed  that  the  asymptotically  optimal  nonlinearity  again  satisfied  an  integral  equa¬ 
tion.  which  in  this  case  involved  second  order  statistics  of  both  the  signal  and  the  noise. 
Noting  that  finding  an  exact  solution  was  often  limited  in  practice  by  the  numerical  tech¬ 
niques  employed  as  well  as  the  expected  inexact  statistical  knowledge,  it  was  concluded 
that  the  actual  nonlinearity  obtained  was  only  approximately  optimal.  We  therefore  won- 


dried  whether  other  approximations  might  offer  certain  advantages,  and  thus  pursued  an 
investigation  into  the  general  problem  of  approximating  a  detector  nonlinearity.  This  led 
to  a  result  which  established  sufficiency  conditions  for  the  performance  of  a  sequence  of 
approximations  to  converge  to  the  performance  of  a  given  detector.  We  then  applied  these 
conditions  to  the  case  where  the  optimal  detector  nonlinearity  was  approximated  by  a 
quantizer  or  by  a  polynomial.  Our  results  specified  the  form  of  the  optimal  M-level  quan¬ 
tizer:  moreover,  it  was  shown  that  the  performance  of  the  resultant  detector  converged  to 
opt  imal  as  the  number  of  quantization  levels  approached  infinity.  Since  one  may  be  inter¬ 
ested  in  quantizing  to  implement  the  detector  digitally,  the  use  of  such  quantizers  might 
be  attractive.  We  also  specified  the  form  of  the  optimal  polynomial  of  a  given  degree,  and 
found  that  it  could  be  obtained  simply  by  solving  a  set  of  linear  equations  which  involved 
joint  moments  rather  then  densities.  We  then  showed  that  for  a  large  class  of  noises  the 
resultant  detector's  performance  converged  to  optimal  as  the  degree  of  the  polynomial 
approached  infinity.  Because  of  these  convergence  results,  we  therefore  concluded  that  the 
employment  of  a  quantizer  or  polynomial  detector  allowed  performance  arbitrarily  close 
to  optimal.  These  results  were  delineated  in  £12  of  the  publication  list. 

As  with  much  work  which  deals  with  memorvless  detection,  the  results  described 
above  were  obtained  in  conjunction  with  stationarity  assumptions  which  were  imposed  on 
the  signal.  Because  there  are  many  cases  where  a  stationarity  assumption  regarding  the 
signal  nun  not  be  appropriate  due  to.  for  example,  manmade  factors  affecting  the  signal, 
we  then  sought  to  investigate  applications  of  memoryless  discrete  time  detection  to  the 
case  of  a  time  varying  deterministic  signal  in  dependent  non-Gaussian  noise.  Using  the 
criterion  of  asymptotic  relative  efficiency,  we  first  specified  the  form  of  the  optimal  detector 
for  the  case  when  the  detector  class  considered  consisted  of  a  time  invariant  memoryiess 
nonlinearity  followed  by  an  accumulator  and  threshold  comparator,  the  same  detector  class 
considered  by  us  in  other  contexts  for  various  stationary  signal  cases.  Having  noted  that 
the  nonstationarity  of  the  signal  might  make  appropriate  a  different  detector  model,  we 
then  employed  a  model  which  included  a  time  varying  memoryless  nonlinearity.  We  again 
specified  the  form  of  the  optimal  detector  for  this  detector  class.  Several  specific  examples 
wi  re  considered,  and  graphs  of  the  appropriate  optimal  nonlinearities  w'ere  provided.  We 
t hen  evaluated  the  asymptotic  performance  of  the  optimal  delectors  of  the  two  classes, 
and  it  was  seen  that  for  the  examples  considered  ihe  time  varying  nonlinearity  led  to 
superior  performance.  Finally,  in  order  to  reduce  the  amount  of  statistical  knowledge  of 
t lie  noise  required  for  the  design  of  the  detector,  an  approach  was  presented  which  involved 
employing  polynomial  approximations  of  the  nonlinearities  of  interest.  Graphs  were  then 
obtained  of  the  optimal  polynomials  of  a  given  degree  for  various  examples.  These  results 
were  delineated  in  •••  ?>  and  of  the  publication  list. 

We  have  also  observed  that  in  order  to  obtain  improved  performance  it  might  be 
desirable  to  allow  the  detector  to  possess  memory.  The  presence  of  a  rionst at ionarv  signal 
in  conjunction  with  a  dependent  noise  process  often  complicates  the  design  of  the  detector: 
moreover,  in  some  such  cases  applications  of  known  approaches  which  account  for  the  noise 
dependency  arc  inhibited  by  lack  of  knowledge  of  the  higher  order  noise  statistics.  If  the 
noise  dependency  were  weak  the  temptation  to  ignore  it  might  therefore  arise.  Wo  were 
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thus  Ifd  to  consider  the  dis<  rete  time  detection  with  memory  of  time  varying  deterministic 
signals  in  weakly  dependent  noise.  We  investigated  quantitative  conditions  which  allowed 
determining  when  the  dependency  could  be  ignored,  and  presented  a  result  which  allowed 
hounding  the  variation  in  false  alarm  rate  and  detection  probability  induced  by  ignoring 
the  dependency.  The  case  of  stationary  Gaussian  noise  was  then  considered,  and  we 
showed  that  our  result  related  the  bound  on  the  variation  in  false  alarm  rate  and  detection 
probability  to  t  he  rate  of  descent  of  t  he  noise  autocorrelation.  These  results  were  delineated 
in  ••••  •'>  and  •••  I  t  of  the  publication  list. 

f  inally,  we  investigated  more  generally  the  effect  induced  by  the  aforementioned  in- 
exaci  knowledge  of  the  noise  dependency  on  the  detector  data  processor.  Noting  that, 
under  a  variety  of  fidelity  criteria,  this  data  processor  could  be  expressed  in  terms  of  the 
relevant  likelihood  ratio,  we  considered  the  variation  in  the  likelihood  ratio  as  the  noise 
distribution  functions  were  varied  about  their  nominal  values.  Our  results,  which  first 
were  applied  to  the  detection  of  a  time  varying  deterministic  signal  in  additive  noise  and 
then  were  extended  to  a  more  general  situation  in  which  the  signal  possessed  a  random 
amplitude,  characterized  a  class  of  noise  contaminants  over  which  the  likelihood  ratio  was 
invariant.  It  was  then  shown  by  example  that  such  a  class  contained  distribution  functions 
that  differed  greatly  from  the  nominal  distribution  function,  yet  still  yielded  the  same 
likelihood  ratio.  A  key  element  common  to  these  results  was  that  a  contaminant  which 
wa>-  a  pe  riodic  multiple  (with  period  equal  to  the  signal)  of  the  nominal  density  led  to  an 
unperturbed  likelihood  ratio.  These  results  were  delineated  in  ~  of  the  publication  list. 
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Current  research  is  directed  toward  I  he  areas  of  signal  detection  and  data  compression 
for  image  processing.  Most  of  this  work  lias  as  a  goal  the  admission  of  non-Gaussian  pro¬ 
cesses  with  dependency .  In  addition,  we  are  heavily  interested  in  approaches  which  require 
only  moderate  amounts  of  statistical  knowledge,  thus  yielding  greater  utility  in  practice. 
This  is  resulting  in  the  attractiveness  of  robust  or  nonparametric  schemes.  Because  in 
many  cases  we  might  expect  the  presence  of  dependency  in  the  underlying  random  pro¬ 
cesses.  we  are  particularly  interested  in  studying  robust  or  nonparametric  schemes  with 
application  to  dependent  processes.  These  are  areas  for  which  few  results  exist  in  the  de¬ 
pendent  non-Gaussian  case,  and  thus  the  employment  of  unconventional  techniques  might 
in  no<essar\. 
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